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SSGNIPICANCE  AND  EXPLANATION 
Let  p(k)  =  exp  ( -^  )  •  I  (k  0,1,,..)  he  the  Poisson  mass  function. 

In  a  variety  of  application  contexts,  it  la  necessary  to  compute  Infinite  sums 
involving  these  probahillties.  For  example,  such  sums  occur  naturally  in 
numerical  algorithms  developed  for  Poisson  variate  generation  purposes  and  for 
computing  terminal  rewards  of  unlformizahle  continuous-time  Markov  chains. 

From  a  practical  standpoint,  it  la  necessary  to  truncate  these  infinite  sums 
after  a  finite  number  of  terms.  Development  of  a  priori  error  bounds  on  the 
error  incurred  by  this  kind  of  truncation  requires  bounds  on  the  left  and 
right  tails  of  the  Poisson  distribution;  such  bounds  are  given  here.  These 
bounds  are  easily  computable  in  a  numerically  stable  way,  even  when  the 
Poisson  parameter  X  is  large. 
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UPPER  BOUNDS  ON  POISSON  TAIL  PROBABILITIES 


Peter  M.  Glynn 

1 .  INTRODUCTION 

Let  p(lc)  =■  exp(-X)"XVkl  (k  “  0,1,...)  be  the  Poisson  mass  function.  Our  goal  in 
this  paF>er  is  to  provide  upper  bounds  on  the  left  and  right  tall  probabilities,  which  are 
defined  respectively  by  the  formulae 

n 

P(n)  -  I  p(k) 
k-0 

«» 

P(n)  “  1  P(k) 

k«n 

Such  bounds  have  application  in  several  numerical  methods  arising  from  the  analysis  of 
stochastic  systems. 

APPLICATION  1;  To  generate  variates  from  the  clipped  Poisson  distribution,  it  is  common  to 
compute  a  table  of  the  Poisson  distribution  function  (see  Bratley,  Fox,  and  Schrage  (1983), 
p.  170-171  and  p.  334-335).  The  numerical  computation  of  the  table  requires  truncating  the 
Poisson  tall,  thereby  introducing  numerical  error.  In  order  to  bound  the  numerical  error, 
it  is  necessary  to  have  a  priori  bounds  on  the  probability  mass  of  the  truncated  tails  (see 
Fox  and  Glynn  (1906)). 

APPLICATION  2s  Let  X  ■»  {X(t)  :  t  >  0)  be  a  uniformisable  continuous-time  Markov  chain 
with  generator  Q.  Given  that  f  is  a  real-valued  function  defined  on  the  state  space 
S  of  X,  one  is  often  interested  in  numerically  determining  the  terminal  reward 
r  =  Ef(X(T)).  The  parameter  r  can  be  computed  as 

(1.1)  r  -  y  e"®’’’ Ef(Y(k)) 


for  a  >  A  -  Bup{-(?^  i  x  «  s) ,  where  t  -  {Y(k)  ;  k  >  0}  Is  an  appropriately  defined 
discrete-time  Markov  chain  living  on  S.  Gross  and  Miller  (1984)  have  suggested  numerical 
algorithms  based  on  the  representation  (1.1).  Of  course>  from  a  numerical  standpoint/  it 
is  necessary  to  truncate  the  infinite  sum  appearing  in  (1.1)  at  some  finite  quantity/  say 
m.  lAie  absolute  error  introduced  by  truncating  (1.1)  at  m  is  given  by 

€(a/f)  -  I  I  e'*’^  Ef{Y()c))|  . 

k=m+1 

Let  Ifl  =  sup  lf(x)l  :  X  e  S  .  By  observing  that  |Ef(Y(k))|  <  I  f  I  for  k  >  0/  it 
follows  that  e(a/f)  <  Ifl  •  P(mf1)>  thuS/  for  bounded  functions/  an  explicit  a  priori 
error  bound  can  be  calculated/  provided  that  P(m+1)  can  l>e  (bounded. 

Incidentally/  by  letting  f(*)  ”  K/  one  finds  that 

sup{e(a/f)  :  Ifl  <  K)  “  K*P(m+1)  i 

this  suggests  that  one  should  choose  a  so  as  to  minimize  P(m-fl).  Kecall  that  P(mf1)  • 
P{M(aT)  >  m) /  where  N(*)  is  a  unit  Intensity  Poisson  process.  Since  M(*)  has  non- 
decreasing  pathS/  P(m+1)  must  be  non-decreasing  in  o.  Hence/  the  best  choice  of  a  for 
minimizing  P(m+1)  is  a  «  A. 

APPLICATIONS  3:  The  steady-state  distribution  of  the  M/M/“/“  infinite-server  queue  with 
arrival  rate  1  and  service  rate  U  is  Poisson  with  parameter  X/ii.  An  upper  bound  on 
P(n)  yields  an  upper  bound  on  the  long-run  probability  that  such  a  queueing  system 
contains  n  or  more  customers. 

In  the  above  applications,  an  upper  bound  on  the  tails  is  used  to  determine  n^(e  ), 
02(6)  for  which  P{n^(€)  <  N(X)  <  n2(e))  >  1  -  e,  where  e  is  a  preecrl)>ed  error 
tolerance.  (In  Application  2,  one  would  generally  take  n^(e)  “  0.)  One  can  argue  that  a 
straightforward  method  exists  for  choosing  such  an  (n^  (e  )  ,n2  (e  ) )  pair.  Choose  n^(e)  =  0 
and  let  n2(£)  be  the  first  m  for  which  P(m)  >  1  -  Ej  the  latter  operation  can  be  done 
numerically  by  successively  adding  the  mass  probabilities  p(k).  This  method  has  two 
disadvantages.  Firstly,  the  computation  of  n2(E)  requires  programming  set-up  time  and 


exp«n8e>  Secondly,  for  large  X,  the  computation  of  the  mass  probabilities  p(k) 
Involves  significant  numerical  underflow-overflow  problems;  overcoming  those  difficulties 
Is  non-trivial  (see  Fox  and  Glynn  (1986)). 


e 


On  the  other  hand,  for  large  X,  the  central  limit  theorem  applies  to  yield 

P{X  ♦  r^X^'^2  <  n(a)  <  X  + 

(  1.2) 

♦  ♦(Xj)  -  *(1^) 

as  X  ♦  where  ♦(x)  •  d(t)dt  and  ^(x)  -  (2*)”  ■^2  exp(-x^/2).  The  problem  in 
applying  (1.2)  (together  with  a  table  of  the  normal  distribution  function)  to  obtain  n^(e  ) 
and  n2(E)  is  that  (1.2)  Is  only  true  In  the  limit.  For  finite  X,  (1.2)  gives  no  usable 
Information.  An  obvious  refinement  would  be  to  combine  (1.2)  with  the  Berry-Esseen  theorem 
(see  p.  542  of  Feller  (1971)).  This,  however,  leads  nowhere  since  the  Berry-Esseen  error 
bound  is  Independent  of  and  consequently  gives  no  usable  upper  (sound  on  the 

Poisson  tall  probahllltles. 

Our  error  bounds  avoid  these  difficulties.  Our  first  result  bounds  the  tall 
orobabllltles  In  terms  of  the  mass  function. 


(1.3)  PROPOSITION.  Assume  X  >  0. 

1 . )  If  0  <  n  <  X ,  then 

P(n)  <  p(n)  •  (1  -  (n/X))"’ 


11.)  If  n  >  X-1  and  m  >  1,  then 


P(n)  «  (1  - 


n+m-1 

I  P(h). 

k-n 


The  following  corollary  Is  immediate. 


(1.4)  COROLLARY.  (1)  11m  P(n)/p(n)  -  1 

X+- 

(11)  11m  P(n)/p(n)  -  1. 

nx» 

According  to  the  second  part  of  our  corollary,  virtually  all  the  mass  of  the  Poisson 
right  tall  P(n)  sits  at  the  point  n.  A  further  consequence  of  (1.3)  11.)  (with  ra  -  1) 


l3  that  for  a  >  0 


(1.5) 

which  Implies  that 


(1.6) 


1  < 


ylMJUaJlh 

p(|>(1-K>)]) 


<1  +  1/0 


11m  y  P(  IX(1+a)  I)  »  11m  ^  p(  U  d-W)  I  ) 
!+•  X*« 


-  o  -  (l-KJ)ln(l-ta)  ; 


(1.6)  Is  a  statement  of  Chernoff’s  large  deviations  theorem  (see  Bahadur  (1971),  p.  6-9) 
specialized  to  the  Poisson  distribution.  I^us,  (1.5)  may  be  viewed  as  a  refinement  of 
Chernoff's  result. 

The  bounds  given  by  (1.3)  can  be  used  directly  when  X  is  small,  since  p(h)  can 
then  be  evaluated  without  numerical  difficulties  arising.  If  X  is  large,  it  is  useful  to 
have  error  bounds  on  the  mass  function  itself.  Let  a  »  L^J  . 


(1.7)  PROPOSITION.  Let  X,  n  >  1.  Then, 

i.)  p(a-n)  <  (2ta)~  '^2  exo( -n(n-1  )/2X  ) 

ii.)  p(a+n)  <  (2iia)‘’/2.  expC^^y'—  +  . 

^  12X^ 

The  normal  approximation  (1.2)  indicates  that  the  choices  n)(E),  n2(e )  will  be  of 
order  xV2  from  X.  Thus,  the  values  of  n  appearing  in  (1.3),  which  are  of  moat  concern, 
are  those  within  order  xV2  from  X.  Consequently,  if  X  is  large,  the  factors  i\/K 
and  X/(n+1)  appearing  in  (1.3)  1.)  and  ii.)  respectively  will  be  close  to  one,  causing 
the  bounds  to  blow  up.  Thus,  more  refined  bounds  are  needed  when  X  is  large. 

(1.8)  THEOREM.  Suppose  X  >  2.  Let  ♦(x)  “  tl-x)  be  the  standard  normal  right  tail 
probability. 

1.)  If  n  >  2, 

P(a-n)  <  exp(1/8X).(1  +  ■p)**("-V— ) 

X  ^/2 

ii.)  If  2  <  n  <  (X+3)/2, 

P(a+n)  <  exp(1/8X).(1  +^)*/2*[l  -  • 


An  obvious  limitation  of  (1<3)  li>)  is  ths  restriction  on  the  size  of  n<  However/ 
since  one  expects  to  use  these  bounds  only  for  large  X  (in  which  case  n  will  tend  to  be 
of  order  x’/a  ),  this  restriction  is  not  serious*  To  avoid  the  computation  of  the 
numerically  hard-to-compute  reciprocal  factor  In  (1.8)  li.)#  we  also  offer  the  following 
bound . 

(1.9)  PROPOSITION.  Suppose  X  >  2.  For  2<  n<  (X+3)/2, 

P(a+n)  <  exp(V16)M1  ♦  (1  -  axp( -  |2-) )"’•  *(21^7)  . 

’  (2X)'^ 

Note  that  all  the  terms  appearing  in  the  upper  bounds  of  (1.8)  i.)  and  (1.9)  can  be 
easily  computed  in  a  numerically  stable  fashion.  'Riese  bounds  should  therefore  be  suitable 
for  the  applications  previously  described. 


2.  PROOFS 


PROOF  OF  PROPOSITin*)  1.3:  Observe  that 

n-1 


P(n)  =■  p{n)*  (1  +  I 


n(n-1  )•  *  •  (lt+1 ) 


k-0  X 

n”1  1, 

p(n)-(1  +  I  (f)"  ) 


n-V 


<  o(n)-  ^  -  p(n)-  (1  -  y'"’  • 

k-n 


For  P(n),  It  Is  evlflent  that 


n+m-1 

m 

P(n)  - 

1 

p{k) 

+ 

x".  1 

k*n 

k«n 

oo 

< 

y 

p(k) 

x”.  J 

k=n 

k*n 

n+m-1 

= 

y 

P(k) 

+ 

,  X  m 
‘nTT> 

c 

n 

yields  (1.3) 

il.). 

kl 


(k+Ri)! 


The  following  lemma  collects  a  series  of  Inequalities  which  we  shall  need  for  the 
remainder  of  our  proofs. 


(2.1)  LFHMA.  i.) 

for 

y 

> 

-1,  £n(1+y)  <  y 

ii.) 

for 

y 

0,  -Pn(1+v)  s  -y  +  y^/2 

ill.) 

for 

V 

> 

V, 

0,  ( 1+y)  2  <  1  +  y/2. 

PPOOv.  For  l.)»  let  g(y)  =  y  -  ln(1+y)  and  observe  that  q(0)  »  0  and  a'(Y)  <0  f 
-1  <  y  <  n,  whereas  g'(y)  >  0  for  y  >  0.  Hence,  0  is  a  global  minimizer  of  g(*  ) 
so  that  g(y)  >  g(01  =  h  for  y  >  -1.  The  proofs  of  11.)  and  Hi.)  are  similar. 

PROOF  OF  PROPOSITION  1.7:  For  1  <  n  <  a,  we  use  the  fact  that  a  <  X  to  obtain 


p(a-n)  »  p(a)*  ( — t — ) 


<  p{a)*{1)*(1  -  ) 


n-1 

o{a)*exp(  ^  ln(1  -  ^) ) 
k-O 


By  (2.1)  1.),  ln(1  -  k/X)  <  -k/X  30 


p(a-n)  <  p(a)*exp(-J  kA  ) 
k»0 

“  p(a )*exp(-n(n-1  )/2X  )  , 

by  a  standard  summation  formula  (see  Knuth  (1969),  p.  55).  To  t>ound  p(a),  we  use  a 
Stirling  formula-type  inequality  (see  Feller  (1968),  p.  54) 


>  (2na)^''2a®*e'^*exp(1/(12a+1)) 


which  yields  (b  »  X-a) 


p(a)  < 


-X  .a 
e  -X 


(2.2)  ”  — —  +  ^)* 

/2ita  * 

<  -- —  e  ''•e*’  =>  (2iia)  t 
/2ita 

t)ie  last  inequality  is  obtained  by  exponentiating  botti  sides  of  ln(1+b/a)  <  b/a  (see 
(2.1)  1.)).  This  proves  (1.7  i.)  for  n  <  aj  for  n  >  a,  the  Inequality  is  trite, 
for  p(a+n),  use  a  >  X-1  to  obtain 


p(a+n)  =  p(a)* 


(a+1 )  (a+2)*  •  •  (a+n) 


^  P^®’*X(X+1)**.  (X-m-1) 


p(a)*exp(-  y  ln(1  +  t-)  ) 
k=0 


n-1  n-1  2 

<  p(a)«exp(-  ^  X  *  ^  — 2'  ' 

k-0  k=n  2X 


the  latter  Inequality  by  (2.1)  11.).  'Jelnq  standard  sununatlon  formulae  (see 
p.  55)  and  (2.2)  gives  (1.7)  11.). 


PROOF  OF  THEOREM  1.8;  By  (1.7)  i.), 

P(a-n)  <  (2iia)  '^2.  ^  exp(-  — ) 
k-n 

Since  g(x)  »  -x(x-1)/2X  Is  non-lncreaslng  on  (1/2,»>), 

exp( -x(x-1 )/2X  )  <  exp(-u(u-1 )/2X )du 

for  X  >  3/2.  Thus,  If  n  >  2, 

P(a-n)  <  (2ra)  exp(1/3X  )•  f  ^  ^  exp(-(u-1/2)  V2X  )du 

(2.3) 

<  exp(1/8X)(X/a)''^2*((n_3/2)/xV2  )  ^ 

By  (2.1)  ill.),  (X/a)^2  <  1  +  b/2a.  For  X  >  2,  X  <  [Xj  t  1  <  |X  ]  +  2  -  2/X 
(2/X)*(X-1)  <  |_Xj  +  (2/X)«[^X|  so  that  h/2a  <  l/Xj  eubstltutlnq  Into  (2.3) 

1. ) . 

For  (1.8)  11.),  ve  first  use  (1.3)  11.)  with  m  -  a  to  obtain 

_  X  -1 

P(a+n)  <  (1  -  at'nVl^**~  *  ^  Pfa+k)  . 

k»n 

For  n  <  k  <  n+a-1,  we  have 


where  8 


(2.4) 


1  -  (n+a)/(3X)  ♦  (2X)"’. 

X 


P(a+n)  <  (1  -  ( 


atnti 


k(k-1)  (k-1)k(2k-1) 

12X^ 

k(k-1)  .a 

■  sr- 

By  (1.7)  11.),  it  follows  that 
,  n+a-1 

)®)”  •  (2na)”  '2.  J  exp( -k  (k- 1  )3 /2X  ) 
k*n 


Knuth  (1969) 


”  J 

yields  (1.8) 


As  in  the  bound  for  P(a-n)/  the  latter  sum  is  dominated  by 


Now,  8  <  1  since  n-t-a  >  n  >  2>  furthermore,  since  n  <  (i4'3)/2,  it  follows  that 
8  >  1  -  (X/2  +  3/2  +  X)/3X  +  (2X)"’  -  1/2.  Hence,  B“ ’''z  <  /I,  axp((/«l)  <  exp(1/»),  a: 

<  *‘(-^^^)M2X>"’''2  )  . 

Combining  these  inequalities  and  the  previously  obtalnsd  (X/a)^2  <  ( 1  -«■  ^A)  with  (2.4) 
and  (2.5),  we  get  (1.8)  11.). 

PROOF  OF  PROPOSITION  1.9:  For  X  >  2,  exp(1/8X)  <  exp(1/16),  so  it  rssulns  only  to  show 
that 

(2.6)  (1  -  (-^j^)*)"''  <  (1  -oxp<^))"’  . 

Since  a+1  >  X,  it  follows  that  X/(a+n+1)  <  1  -  (n/CX-fn)).  Now, 

1  ■  *  exp(-n/(X+n)) 

(exponentiate  both  sides  of  (2.1)  1.)),  so 

The  function  f(x)  •  (x-1)/(x+1)  is  non-decreasing  on  t0,“)  so  f(x)  >  f(2)  “  1/3  for 
X  >  2.  Thus,  for  X  >  2,  (X-1)/(X+1)  >  1/3,  proving  that  a  »  (1/3)(X+1).  Hence, 
a(X+n)’^  >  a(X  +  X/2  +  3/2)"^  >  (X+1 )/( 3*  (X  +  1  )♦  3/2)  -  2/9.  Relation  (2.7)  then  yields 

<  •«P(-2n/9)  , 


from  which  (2.6)  follows  immediately 
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